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Introduction 


INTRODUCTION 


Millions of adults in the United States are trying to support 
themselves and their families without a high school education. 
Millions more have finished 12th grade but still lack some of the 
basic reading, writing, and math skills the labor market demands 

of high school graduates. The need to scale proven, cost-effective 
strategies to increase the skills of adult learners, aid their search for 
good jobs, and improve the talent supply of employers is abundantly 
clear. This brief makes a major leap toward that goal, highlighting 
what works best in a steadily expanding approach to adult education 


and training known as “career pathways.” 


Creating effective pathways to and through postsecondary education 
is a foundational strategy for transforming the delivery of education 
and workforce training in this country. Career pathways are rooted 
in the belief that adults of all backgrounds can access and succeed 

in postsecondary programs that include career training to improve 


labor market outcomes. 


A limited but growing body of rigorous evaluation studies examines 
how career pathways influence student success. JFF set out to 
systematically examine these studies with the goal of answering one 
essential question: What do we know about the impact of career 


pathways on adults seeking to attain a living-wage career? 


The results, reported in this brief, make a strong case for 
scaling career pathways to reach many more adult learners. 
Persuasive evidence shows that well-designed career pathways 
can improve academic, employment, and income outcomes 

for adults. Based on experimental or quasi-experimental 
studies, this growing body of results shows that career pathway 
participants are employed and retained in employment at 
higher rates and attain higher wages and annual earnings than 
students with similar characteristics who enroll in training that 
does not use a career pathway approach. They also earn entry- 
level credentials and gain basic skills at higher rates than the 


comparison group. 


Analyzing the results of career pathway program evaluation 
studies is essential to understanding how to make wise 
investments and increase their impact in the future. We began 
this project by identifying large-scale career pathway initiatives 
that had commissioned rigorous evaluation studies. An initial 
group of more than 30 reports was ultimately narrowed to 16 
studies.! JFF researchers and colleagues from other leading 
organizations reviewed the evidence from programs that 


enrolled diverse adult learner populations from 2010 to 2017. 


The first section of this brief describes the core elements of 
career pathway programs and systems. The remainder of 
the report presents our research results, conclusions, and 
recommendations. Appendix A contains a full methodology, 
including contributors to the research project. Appendix 

B contains lists of the 16 studies broken down by these 
focus areas: pathway entry, integrated training, and career 


progression. 


INTRODUCTION 


“Persuasive evidence 
shows that well- 
designed career 
pathways can 
improve academic, 
employment, and 
income outcomes 
for adults.” 


Career Pathway Programs and Systems 


Over the last two decades, strategic 
investments have led to the measured 
expansion of career pathways in many 
states and regions of the United States. The 
leaders of multiple agencies of the federal 
government have agreed to a common 
definition and metrics, state and local 
governments have worked collaboratively 
to support implementation, and national 
foundations have funded experimentation 
to move career pathways from a lofty 


vision to a tangible reality. 


CAREER PATHWAY PROGRAMS AND SYSTEMS 


The varied models of career pathways that 
have emerged (and continue to emerge) 
represent attempts to make substantive 
changes in the ways adults are educated for 
employment and progress through careers. 
Evaluating how career pathway programs 
are implemented and how they impact 
learners is essential to making continuous 


improvements. 


Asset Framing 


Given the importance of achieving greater equity in education and employment outcomes, 
we believe some of the terminology associated with career pathways needs to change. Too 
often the literature uses terms to describe adult populations by their vulnerabilities rather 
than by their strengths. Labels such as “low-skill,” “low-income,” and “at-risk” focus on 
the person rather than systems that have failed adults, limiting our capacity to see adults 


as successful learners and employees. 


We recommend eliminating the deficit language that is used too pervasively in the career 
pathway literature in favor of an asset-based narrative that affirms adults as valued 


learners and employees. 


In carrying out this project, we have replaced deficit terminology with an asset-based 


narrative that more honorably describes the adult learners who we strive to engage in 


career pathway programs. 


Career pathway programs and systems 
deliver intentionally structured curriculum 
and student-focused supports that 

enable learners to pursue occupationally, 
technically, and professionally oriented 
postsecondary education and workforce 
training. This education and training, 

in turn, supports job entry and career 
advancement that offers a viable economic 
future for the students, their families, and 


their communities. 


CAREER PATHWAY PROGRAMS AND SYSTEMS 


Career pathways include a wide range 
of core program elements, optimally 
guided by strategic education, employer, 
workforce, and community partnerships. 
These core elements include curriculum 
and instruction, work-based learning 
opportunities, industry-recognized 
credentials, proactive student supports, 


career guidance, and job placement. 


Across the career pathway continuum, 


three areas of focus emerge: pathway entry, 


integrated training, and career progression. 
Prior reviews of career pathway studies 
have tended to bifurcate education and 
employment outcomes, but we think this 

is a mistake. It masks the ways in which 
these outcomes align with the three 

foci areas and relate to one another as 


students progress along a career pathway. 


Pathway Entry 


By framing the findings around critical 
aspects of the pathway, we are able to 
understand the research findings more 
holistically and to devise implications and 
recommendations for policy and practice 
that are richer and more meaningful to the 


field. 


Some career pathway programs provide preparatory education and 
training, including bridge programs, designed to help students move 
from entry-level coursework (including those that do not confer college 
credit) to credit-bearing postsecondary coursework and employment. 


Integrated Training 


Integrated training—which is skills focused, college-credit bearing, 
and strongly linked to well-paying, middle-skill jobs—is made possible 
by intentional and authentic partnerships involving employers, 
workforce training, adult education, postsecondary education, and 
other providers who offer industry-recognized credentials in high- 
demand occupations leading to family-supporting jobs and career 


opportunities. 


Career Progression 


Career progression includes strategies that enable adult learners to 
advance in postsecondary education and training beyond entry level to 
secure multiple—including stacked—credentials (certificates, licenses, 
and degrees), to enter and progress through careers that provide 
financial stability. 
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Results 


We present the results of our analysis below, divided into each of the career pathway focus areas 
described above, followed by policy recommendations and suggestions for further research. For a 
detailed discussion of our research methods, including our evaluation study selection criteria, the 


review process, outcome measures, and our analytical framework, see Appendix A. 


Pathway entry 


PATHWAY INTEGRATED CAREER 
ENTRY TRAINING PROGRESSION 


Positive and significant impact is associated with pathway entry that enables students to 
attain an industry-recognized credential that is aligned with local employment. 


Pathway entry represents the starting point to career pathway programs for many adult learners, 
underscoring the importance of preparatory learning to enable students to gain and retain quality 
employment. Adults who have not completed high school or who have modest or no formal 
education beyond high school focus on academic skills they need to succeed in college coursework. 


Pathway entry also focuses on employability skills and initial job experience. 


Seven of the career pathway evaluations that we reviewed included Adult Basic Education or GED 
preparation; bridge programs offering basic academic, employability, and initial occupational skills 


training; and initial employment transition services. 


Impact* 


Results from five of the seven evaluations that assessed outcomes aligned with pathway entry 
showed significant differences in basic skills gains, college credits, and entry-level credentials 
earned by career pathway participants relative to a comparison/control group. For example, two 
studies show 20 to 30 percent higher GED or developmental placement pass rates for career 


pathway participants compared to a control/comparison group.° Three studies show between 9 and 
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17 percent higher rates of retention in training programs for participants compared to a control/ 
comparison group. Also, two studies show entry-level credential attainment rates that are 11 to 
50 percent higher for career pathway participants than a control/comparison group. Specifically, 


career pathway participants: 


¢ Made basic skills gains at a higher rate ¢ Earned an entry-level credential, 
than the control/comparison group. including vocational certificate or 
* Completed more contextualized Se ee 
instruction than the control/ control/comparison group. 
comparison group. ¢ Demonstrated mixed results for 
¢ Earned a modest number of college employment and earnings. Some 


eredlite tnchidiee teal nimecrelaned studies showed modest positive gains, 


oiedils ara Mighertatechanthe while others showed no difference 


Zomirdl/comparisonerouy. between career pathway participants 


and the control/comparison group. 


Implementation 


Pathway entry is more successful, according to our analysis, when the following program elements 


are present: 


¢ Engagement between adult basic ¢ Contextualized basic skills curriculum 
education and postsecondary and instruction that increase student 
education, including postsecondary preparation for further postsecondary 
career and technical education, education. 


rkforce training, and employers. — 
py oei space seating ons ciple yet * Case management and navigational 


¢ Strategic outreach, recruitment, services, including academic and 


and intake of adult learners from career advising, that help retain adults 


diverse backgrounds, informed by in education and training 
in-depth knowledge of the education 
¢ Job-readiness and employment 
and employment needs of these 
. assistance services that help adults 
populations. 
enter employment. 
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Integrated Training 


AN INTEGRATED CAREER 
ENTRY TRAINING a OLE] 41) (0])| 


Positive and significant impact is associated with integrated training that is skills focused, 
college-credit bearing, and strongly linked to well-paying, middle-skill jobs. 


Integrated training and education emanates from adult education and workforce development 
program models that provide simultaneous instruction in basic skills and occupational or industry- 
specific training. Integrated training provides postsecondary academic, occupational, and technical 
skills that enable students to attain the competencies and credentials they need to enter and 


advance in living-wage employment. 


Twelve of the career pathway evaluation studies that we reviewed offered occupational, technical, 
and professional curriculum and instruction; proactive academic and career advising services; 
financial assistance advising and aid; employment assistance and career counseling; and other 


related services to enhance student success. 


Impact 


Five of the 10 evaluations of integrated training show significant credential attainment, and wage 
and earnings gains for career pathway participants relative to a control/comparison group.° Four 
studies show between 18 and 29 percent higher rates of credential attainment for career pathway 
participants compared to a control/comparison group, and two studies showed $4,500 to $5,000 
higher annual earnings two years after program enrollment for career pathway participants relative 
to a control/comparison group. Across the five studies that demonstrated significant results in most 


of these critical outcomes areas, career pathway participants: 


¢ Were more likely to attain higher ¢ Were more likely to complete a 
wages and annual earnings than the training-related credential above 
control/comparison group, and this entry level but typically below an 
positive impact grew at two or more associate’s degree and be employed 
years beyond program completion; and retained in training-related jobs 
and than a comparison/control group. 
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In several studies, the impact on other education and employment outcomes varied in significance 


and strength by provider (especially community colleges versus for-profit institutions) and 


occupation (e.g., health care versus manufacturing). A few studies that broke out employment and 


earnings outcomes by participant demographics showed positive results for student subgroups as 


well. 


Implementation 


Integrated training is more successful, according to our analysis, when the following program 


elements are included: 


Employer engagement and 
partnerships with public and private 
education and training providers, 
including community colleges and 
for-profit providers, that focus on in- 


demand industries and occupations. 


Occupational, technical, and 
professional skills training 

that confers college credit in 
postsecondary programs leading to 


well-paying, middle-skill jobs. 


Comprehensive supports, including 


case management and navigators, that 


help adults progress through training 


and transition into employment. 


Financial aid, advising, and 
individualized training plans that 
enable students to complete education 


and transition to employment. 


Job development and placement 
services that help adults enter 
positions in family-supporting 


employment. 


INTEGRATED TRAINING 


Career Progression 


PATHWAY INTEGRATED CAREER 
ENTRY TRAINING ANOLE] 41] (0]) | 


Limited evidence exists on the impact of career progression on student-level education and employment. 


A fundamental tenet of career pathways is to help students not only find family-supporting 
employment but also to return to and engage in additional postsecondary education that enables 
them to advance in their careers. To accomplish this goal, students need ongoing access to 
education and training that offers multiple credentials, often referred to as “stackable,” that fulfill 


both immediate- and long-term career goals. 


Only five evaluation studies included any outcome measures pertaining to time periods extensive 
enough to track impact on longer-term education and employment. A few additional evaluation 


studies were underway at this writing, but longitudinal results were not publicly available. 


Impact 


Results of four of the five evaluations of career progression show no difference in college 
enrollment following participation in an initial career pathway program, or in earning a subsequent 


college credential, relative to the control/comparison group.’ The results were mixed on:° 


¢ Enrollment in additional ¢ Employment retention for career 
postsecondary and training for career pathway participants relative to the 
pathway participants relative to the control/comparison group. 


control/comparison group. 


* Credential attainment, including the 
associate’s degree, for career pathway 
participants relative to the control/ 


comparison group. 


CAREER PROGRESSION 15 


Implementation 


Career progression may be more successful, according to our analysis, when the following elements 


are included: 


¢ Employer partnerships emphasize studies reveal that students often 


industry-sponsored training and do not take advantage of stackable 
benefits that enable incumbent credential offerings, which suggests 
workers, who are actively employed, that further research into ways to 
to enroll in college to pursue improve student participation in these 
additional postsecondary education programs is needed. 


and credentials. 
¢ Employer-sponsored postsecondary 


Work-based learning, including 
apprenticeships, may be integrated 


into postsecondary and workforce 


education and training benefits that 
enable adult learners to progress in 


chosen careers or transfer skills and 


training. competencies to change career paths. 


* Postsecondary education and training 
providers design and offer curricula 


that include stackable credentials; 
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Recommendations 


The promising results of career pathway programs highlighted 

in this report underscore the need to scale approaches that work. 
The following recommendations include program design practices, 
policy approaches, and system-wide actions. We also recommend 


that additional research be conducted in specific areas. 


Practice 


Based on our research findings, we recommend the following 
practical approaches to expanding career pathways for adult 


learners: 


¢ Adopt and scale effective integrated training models across 
states in order to promote accelerated credential attainment 


and entry into good jobs. 


¢ Explore implementation of upskilling and work-based learning 
by advancing worksite training models to reengage and 


accommodate working learners. 


¢ Scale comprehensive career pathways beyond the entry level, 


promoting real opportunities for career advancement. 


¢ Equip state education and training system leaders and the field 
with real-time labor market analyses to facilitate selection 
of credentials that promote upward economic mobility for 


students and workers. 
Policy 


Policy conditions and strong incentives are needed to scale what we 
know works for adult learners. We recommend the following policy 


recommendations at the state and federal levels: 


RECOMMENDATIONS 
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* Incentivize integrated education 
and training models that both help 
accelerate credential attainment 
and respond to employer needs and 


regional workforce efforts. 


¢ Support public/private employer 
partnerships that help to upskill 
learners and workers along a career 


pathway beyond entry level. 


* Use the federal Ability to Benefit 


provision to help more students 
access federal financial aid / grants 
required to cover college credentials/ 


degrees. 


¢ Establish state sponsorship of “what 


works for adult learners” institutes 
to help scale promising models and 
drive stronger adult education and 
workforce system performance 


outcomes. 


Other Strategies 


In addition to practice and policy recommendations, we have identified a number of other 


strategies that can advance efforts to create and scale career pathways for adult learners: 


¢ Support scaling of effective practice ¢ Anchor and scale the 


by capitalizing on the efforts and 
communication channels of national 
networks focused on adult learners 
representing over half a million 


students. 


¢ Adapt and scale effective integrated 
training models to new populations, 
such as English language learners, 
reentry populations, career and 
technical education students, and 


developmental education students. 


RECOMMENDATIONS 


recommendations of this report by 
institutionalizing transformative 
practice and policy through 
investment in a national center, 
possibly housed at JFF, and in 
partnership with key organizations, 
focused on the advancement of policy 


and practice for adult learners. 
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Research 


Our systematic review of career pathways 
shows positive education and employment 
outcomes, especially as participants extend 
their time in the labor market. However, 
results from rigorous evaluation are still 
limited but emerging, leaving knowledge 
gaps that need to be addressed. We 
recommend additional research in the 


following areas: 


¢ Industry sectors other than health 


care and manufacturing. 


¢ Subgroups by site and demographics 
(race/ethnicity, age, gender, income, 


etc.). 


¢ Program elements such as 
contextualized curricula, proactive 


advising, and job transition. 


¢ More states and geographic regions, 


especially rural regions of the country. 


¢ More extended tracking of 
employment and earnings outcomes 


through career ladders and lattices. 


Research is needed in all focus areas: 
pathway entry, integrated training, and 


especially career progression. 


RECOMMENDATIONS 


Conclusion 


In light of the evidence, the strong 
economy, and the growing interest in 
implementing career pathway approaches, 
we believe that now is an important time to 


scale these approaches. 


This paper summarizes the key research 
findings. Translating these findings for 
broader impact requires us to think 
differently about a holistic approach to 


scale and ask: 


¢ What needs to happen, that hasn’t 
happened, to make promising models 


the norm? 


¢ How do we ensure that all students/ 
workers who can benefit from these 
approaches can access them and are 


ready to succeed? 


¢ How can we increase the number 
and quality of integrated pathway 
programs offered to potential adult 


students? 


¢ How can we redesign career pathways 
so that they can create career 
opportunities that go beyond the first 
job? 
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Appendix A: 
Research Methods 


Evaluation Study Selection Criteria 


We began this project by identifying large-scale career pathway initiatives that had commissioned 
rigorous evaluation studies. More than 30 reports were included in this search, which was 
ultimately narrowed to 16 studies. Some studies have met the U.S. Department of Labor’s CLEAR 
or the U.S. Department of Education’s What Works Clearinghouse criteria, and some of the 

more recent studies may meet these criteria once they have been reviewed. We also queried the 
Education Full Text, ERIC, and Google Scholar search engines to look more broadly at literature on 
career pathways, not so much to analyze impact studies per se but to situate our results in themes 


and trends in the larger body of literature on career pathways. 


ils) 


STUDIES 


419 


CAREER PATHWAY RESEARCH 
DOCUMENTS (2010-17) 


1,820 


CAREER PATHWAY DOCUMENTS (2013-17) 
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Evaluation Studies 


Our systematic review included 10 
randomized control trials and four quasi- 
experimental design (QED) studies. Most 
of these studies also integrated qualitative 
methods to evaluate implementation. 
With respect to the QEDs, all four used 
Propensity Score Matching and one also 
used Differences-in-Differences. We 

also took into account the large-scale 
qualitative evaluation from Shifting Gears, 
a Joyce Foundation supported initiative, as 
well as the systematic review of workforce 
training authored by multiple federal 
agencies.” 

The selected studies concentrated on 
career pathway programs within states, 
within regions of the country, and 

across multiple states across the nation. 
Regardless of state or region, most 
programs were located in medium or large 
urban locales, with fewer situated in rural 
areas. 

Also, the preponderance of evaluations 
focused on programs in health care and 
manufacturing, with much more modest 
evidence of the trades, construction, 
transportation and logistics, and other 


areas. 


APPENDIX A: RESEARCH METHODS 


randomized control 
trials, with most using 
mixed methods 


quasi-experimental 
designs (propensity 
score matching 

and differences in 
differences, with most 
using mixed methods) 


large-scale 
longitudinal 
qualitative study 


systematic literature 
review 
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The Review Process 


Our systematic review included reading, notating, coding, and critically analyzing the selected 


studies to address the main research question: 


What impact do career pathway programs have on adult learners’ educational and 
employment outcomes? 

The review process included categorizing each study’s evaluation questions, design(s) 
and sources of evidence, outcome measures, analysis and interpretation methods, and 
generalizations. Limitations, including estimated bias, were also noted. 

Our review methods were consistent with the American Educational Research 
Association (AERA 2006) guidelines that specify that all research claims (quantitative 


and qualitative) be both warranted and transparent. 


Outcome Measures 


Our analysis included assessing categories of outcomes associated with the three focus areas of 


pathway entry, integrated training, and career progression. 


= 
Cc 


| > 


Employment outcomes include placement in employment, including training-related 
employment; hourly wage and earnings gains; employment retention and promotion 


along career progress; and job quality and satisfaction. 


Education outcomes include non-college and college-credit attainment; program 
completion; credential attainment, including certificate and degree attainment; and 


continuation in postsecondary education and workforce training. 


Other outcomes include change in financial stability, public assistance services, and 


other quality-of-life indicators. 
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Analytical Framework 


Our analytical framework identifies outcome measures aligned to pathway entry, integrated 
training, and career progression. Some outcome measures apply to one focus and some apply to 
multiple foci to reflect the progress that learners can make as they move back and forth between 


workforce training, postsecondary education, and employment over the course of their lives. 


PATHWAY INTEGRATED CAREER 
ENTRY TRAINING ed COLE] 41] (0) | 


e Basic skills e Occupation e Multiple 
attainment skills attainment credential 
attainment 
¢ College credit e Program 
attainment completion e Continued 
integrated 
¢ Program ¢ Credential training and 
completion attainment postsecondary 
education 
e Credential ¢ Quality 
attainment employment ¢ Career 
and retention progress 
e Entry into 
quality e Wage and 
employment earnings gains 
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Panel Participants 


JFF would also like to thank the following individuals who participated in panel discussions on 


“What Works for Adult Learners.” We appreciate their willingness to review documents, offer 


reflections, and share findings with their professional communities to help advance the progress of 


adult learners. 


Theresa Anderson 
The Urban Institute 


Amanda Bergson-Shilcock 
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Diane Bosak 
Achieving the Dream 


Jay Box 
Kentucky Community & 
Technical College System 


Courtney Brown 
Lumina Foundation 


Brandon Butler 
Maryland Department of Labor 


Mark Elliott 
Mobility 


Lauren Eyster 
The Urban Institute 


Jennifer Foster 
Illinois Community College Board 


Sameer Gadkaree 
The Joyce Foundation 


Sandy Goodman 
World Education 


Colanie Gray 
U.S. Department of Education 


Sara Hastings 
Employment and Training 
Administration, 

U.S. Department of Labor 


Meredith Hatch 
Achieving the Dream 
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Greater Washington 
Community Foundation 
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New America 
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Center for Law and Social Policy 


Benton Murphy 
Greater Washington 
Community Foundation 


Iris Palmer 
New America 


Neil Ridley 


Georgetown University Center 
on Education and the Workforce 


Brandon Roberts 
Brandon Roberts & Associates 


Elisabeth Sachs 


Lumina Foundation 


Wendi Safstrom 
Society for Human Resource 
Management Foundation 


John Shortt 
National Restaurant Association 
Educational Foundation 


Whitney Smith 
JPMorgan Chase & Co. Global 
Philanthropy 
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ECMC Foundation 


Johan Uvin 
Institute for Educational 
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Appendix B: 
Evaluation Studies Reviewed 


We analyzed the results of 16 career pathway program evaluation studies to reach the findings we 

present in this report. Our analysis included assessing categories of outcomes associated with three 
focus areas: pathway entry, integrated training, and career progression. Here are lists of the studies 
that addressed each of those focus areas. Some studies looked at all three focus areas, others looked 


at two of them, and a few only looked at one. 


Pathway Entry 


Anderson, Theresa, Daniel Kuehn, Lauren Eyster, Burt Barnow, and Robert Lerman. New Evidence 
on Integrated Career Pathways: Final Impact Report for Accelerating Opportunity. Washington, DC: 
Urban Institute, June 2017. 
http://www.urban.org/sites/default/files/publication/91436/ao_final_impacts.pdf 


College Count$. Evidence of Impact. The Arkansas Career Pathways Initiative: Phase One Research 
Results. Little Rock, AR: College Count$, 2016. 
https://staticl.squarespace.com/static/55784275e4b0b9063308b099/t/5a344270652dea7bc2cf5 
6¢9/1513374321951/CC+Phase+One+Research+Results.pdf 


Gardiner, Karen, Howard Rolston, David Fein, and Sung-Woo Cho. Pima Community College 
Pathways to Healthcare Program: Implementation and Early Impact Report Appendices. Pathways 
for Advancing Careers and Education. OPRE Report No. 2017-10. Bethesda, MD: Abt Associates, 
April 2017. 
https://www.acf.hhs.gov/sites/default/files/opre/pathways_to_healthcare_implementation_and_ 
early_impact_appendices.pdf 


Martin, Vanessa, and Joseph Broadus. Enhancing GED Instruction to Prepare Students for College 
and Careers. New York: MDRC, May 2013. 
https://www.mdrc.org/sites/default/files/Enhancing_GED_Instruction_brief.pdf 


Modicamore, Dominic, Yvette Lamb, Jeffrey Taylor, Ama Takyi-Laryea, Kathy Karageorge, and 
Enzo Ferroggiaro. Accelerating Connections to Employment Volume 1: Final Evaluation Report. 
Fairfax, VA: ICF, 2017. 


http://resources.baltimorecountymd.gov/Documents/EconomicDevel/acevolumel1.pdf 
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Peck, Laura, and Eleanor L. Harvill. “Early Impacts of the Health Professions Opportunity Grant 
Programs.” Abt Associates. Presentation at the APPAM Research Conference, Chicago, November 
3, 2017. 

https://appam.confex.com/appam/2017/webprogram/Paper22928.html 


Roberts, Brandon, and Derek Price. Building Career Pathways for Adult Learners. Chicago: The 
Joyce Foundation, September 2015. 
http://www.dvp-praxis.org/wp-content/uploads/2015/09/joyceFnd_ShiftingGears3.0-FINAL- 
REPORT. pdf 


Zeidenberg, Matthew, Sung-Woo Cho, and Davis Jenkins. “Washington State’s Integrated Basic 
Education and Skills Training Program (I-BEST): New Evidence of Effectiveness.” CCRC Working 
Paper No. 20, Community College Research Center, Teachers College, Columbia University, New 
York, NY, September 2010. 


https://ccrc.tc.columbia.edu/publications/i-best-new-evidence.html 


Integrated Training 


Anderson, Theresa, Daniel Kuehn, Lauren Eyster, Burt Barnow, and Robert Lerman. New Evidence 
on Integrated Career Pathways: Final Impact Report for Accelerating Opportunity. Washington, DC: 
Urban Institute, June 2017. 
http://www.urban.org/sites/default/files/publication/91436/ao_final_impacts.pdf 


Betesh, Hannah, Hui Kim, Deborah Kogan, Rachel Lindy, and Anne Paprocki. Evaluation of 
Accelerated Training for Illinois Manufacturing (ATIM): Impact Report. Oakland, CA: Social Policy 
Research Associates, April 2017. 
http://www.spra.com/wordpress2/wp-content/uploads/2017/05/ATIM-Impact-Report_Final.pdf 


College Count$. Evidence of Impact. The Arkansas Career Pathways Initiative: Phase One Research 
Results. Little Rock, AR: College Count$, 2016. 
https://staticl.squarespace.com/static/55784275e4b0b9063308b099/t/5a344270652dea7be2cf5 
6c9/1513374321951/CC+Phase+One+Research+Results.pdf 
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Elliott, Mark, and Anne Roder. Escalating Gains: Project QUEST’s Sectoral Strategy Pays Off. New 
York: Economic Mobility Corporation, April 2017. 
https://economicmobilitycorp.org/wp-content/uploads/2018/01/Escalating-Gains_WEB.pdf 


Farrell, Mary, and Karin Martinson. The San Diego County Bridge to Employment in the Healthcare 
Industry Program: Implementation and Early Impact Report. Pathways for Advancing Careers and 
Education. OPRE Report No. 2017-41. Bethesda, MD: Abt Associates, June 2017. 
https://www.acf.hhs.gov/sites/default/files/opre/bridge_to_employment_implementation_and_ 
early_impact_report_final_pdf.pdf 


Hendra, Richard, Keri-Nicole Dillman, Gayle Hamilton, Erika Lundquist, Karin Martinson, and 
Melissa Wavelet. How Effective Are Different Approaches Aiming to Increase Employment Retention 
and Advancement? New York: MDRC, April 2010. 

https://files.eric.ed.gov/fulltext/ED514699.pdf 


Maguire, Sheila, Joshua Freely, Carol Clymer, Maureen Conway, and Deena Schwartz. Tuning In 
to Local Labor Markets: Findings from the Sectoral Employment Impact Study. New York: Public/ 
Private Ventures, 2010. 

http://www.aspenwsi.org/wordpress/wp-content/uploads/TuningIntoLocalLaborMarkets.pdf 


Martinson, Karin, Julie Williams, Karen Needels, Laura Peck, Shawn Moulton, Nora Paxton, 
Annalisa Mastri, Elizabeth Copson, Hiren Nisar, Alison Comfort, and Melanie Brown-Lyons. The 
Green Jobs and Health Care Impact Evaluation: Findings from the Impact Study of Four Training 
Programs for Unemployed and Disadvantaged Workers. Bethesda, MD: Abt Associates, May 2016 
https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20from%20 
the%20Impact%20Study.pdf 


Michaelides, Marios, Peter Mueser, and Kassim Mbwana. Quasi-Experimental Impact Study of 
NFWS/SIF Workforce Partnership Programs. Columbia, MD: IMPAQ International, March 2014. 
https://www.impagqint.com/sites/default/files/files/NFWS%20Quasi-Experimental%20 
Impact%20Study%20-%20March%202014%20-%20Release%20Copy-1.pdf 
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Modicamore, Dominic, Yvette Lamb, Jeffrey Taylor, Ama Takyi-Laryea, Kathy Karageorge, and 
Enzo Ferroggiaro. Accelerating Connections to Employment Volume 1: Final Evaluation Report. 
Fairfax, VA: ICF, 2017. 


http://resources.baltimorecountymd.gov/Documents/EconomicDevel/acevolumel.pdf 


Peck, Laura and Eleanor L. Harvill. “Early Impacts of the Health Professions Opportunity Grant 
Programs.” Abt Associates. Presentation at the APPAM Research Conference, Chicago, November 
3, 2017. 

https://appam.confex.com/appam/2017/webprogram/Paper22928.html 


Zeidenberg, Matthew, Sung-Woo Cho, and Davis Jenkins. “Washington State’s Integrated Basic 
Education and Skills Training Program (I-BEST): New Evidence of Effectiveness.” CCRC Working 
Paper No. 20, Community College Research Center, Teachers College, Columbia University, New 
York, NY, September 2010. 


https://ccrc.tc.columbia.edu/publications/i-best-new-evidence.html 


Career Progression 


Betesh, Hannah, Hui Kim, Deborah Kogan, Rachel Lindy, and Anne Paprocki. Evaluation of 
Accelerated Training for Illinois Manufacturing (ATIM): Impact Report. Oakland, CA: Social Policy 
Research Associates, April 2017. 
http://www.spra.com/wordpress2/wp-content/uploads/2017/05/ATIM-Impact-Report_Final.pdf 


College Count$. Evidence of Impact. The Arkansas Career Pathways Initiative: Phase One Research 
Results. Little Rock, AR: College Count$, 2016. 


https://lincs.ed.gov/professional-development/resource-collections/profile-979 
Elliott, Mark, and Anne Roder. Escalating Gains: Project QUEST’s Sectoral Strategy Pays Off. New 


York: Economic Mobility Corporation, April 2017. 
https://economicmobilitycorp.org/wp-content/uploads/2018/01/Escalating-Gains_WEB.pdf 
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Hendra, Richard, Keri-Nicole Dillman, Gayle Hamilton, Erika Lundquist, Karin Martinson, and 
Melissa Wavelet. How Effective Are Different Approaches Aiming to Increase Employment Retention 
and Advancement? New York: MDRC, April 2010. 

https://files.eric.ed.gov/fulltext/ED514699.pdf 


Modicamore, Dominic, Yvette Lamb, Jeffrey Taylor, Ama Takyi-Laryea, Kathy Karageorge, and 
Enzo Ferroggiaro. Accelerating Connections to Employment Volume 1: Final Evaluation Report. 
Fairfax, VA: ICF, 2017. 


http://resources.baltimorecountymd.gov/Documents/EconomicDevel/acevolumel1.pdf 
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Endnotes 


1. See Appendix B for lists of the 16 studies broken down into the following focus areas: pathway 


entry, integrated training, and career progression. 


2. Raj Chetty, Nathaniel Hendren, Maggie Jones, and Sonya Porter. Race and Economic 
Opportunity in the United States: An Intergenerational Perspective. Cambridge, MA: The 
Equality of Opportunity Project, 2018. 


3. Chetty et al., Race and Economic Opportunity in the United States. 


4. Impact results between treatment and control groups are considered significant when the 
probability level equals or falls below 0.05, with most differences below 0.01, and these 


significant differences were observed across numerous studies—typically three or more. 


5. These results are aggregated from five of the eight studies of Pathway Entry listed in Appendix 
B. 


6. See Appendix B for a list of the 12 studies of Integrated Training. 


7. Many evaluation reports note the serious limitation of time imposed on their capacity to track 
student outcomes to observe career progression outcomes, suggesting the need for more 


longitudinal evaluation designs. 
8. See Appendix B for the list of five studies of Career Progression. 


9. Brandon Roberts and Derek Price, Building Career Pathways for Adult Learners (Chicago: The 
Joyce Foundation, 2015). 
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